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INrRODUCTION 



This document is a description o£ the Third Trial 
using the C.A.L. System, it follows the same 
forniat as the deacription of the Second Trial. 

The main objective of the Trial was to compare 
the perfonnance of students taught by a teacher 
using the C.A.L. Systein with that of students 
taught by the same teacher without the C.A.L. 
Systein, 
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1)1 J HAT L ON I TomAunn wnii five dmiblo los^^ona 

at wcjakly intarvAlii, The laiigtli of 
thoiao periods varied alioljtiy froni 
school to richool arid was btitKoon 65 
and JO niinutQS* In udditioii tlieru wrus 
a homework each w«iek lastinQ for 30 
minutes • 

Testing time for tlie pre and po.^t courgri 
tests ^^65 minutas oach. 

The minimum totr** course iGngth is 7 weeks 
but in some s^wls the course lasted 
longer booausQ half term holidays 5 royal 
weddings and other happy occasions 
Interceded, 



The followiii^ schools took part; 



School 


Class Description 


Clasi 

CAL 


i Siie 
NON -CAL 


Dury Falls School 


Secondary ( Girls) 


17 


21 


Harrow Lodge 


Secondary (Mixed) 


29 


30 




Secondary (Boye) 


28 


29 


Maylands School 


Secondary (GirlM) 


31 


27 


The Campion School 


Granmiar (Boys) 


29 


33 


The Chafford School 


Secondary (Mixed) 


34 


33 


Royal Liberty School 


Grammar (Boys) 


21 


20 


Frances Bardsley School 


GrOTmar (Girls) - 
Non Cal Class 


33 


25 


i 


Secondary (Girl^) - 
Cal Class 






1 


222 


21B 



The class sizey listed above ai"e the student numbei^ on the class 
register and record the maximiim number of students present in each 
class for .each lesson during the trial. The numbar of studentB present 
for the pre and post tests, and therefore available for statistical 
treatnfiant^ is less than that listed above and is m follows s 
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Ihiry Vn] \ t} School 
Harrow LnckiG Schooi 

Mayland?! School 
The Citmpion Scliool 
The Chafford Schnol 
noyal Lihcirty School 
Frail C8S nnrdsloy School 
Totals 



Numbor of b t 
])ro fiiifl poHt 



27 



21 
30 
19 -1 



io^tB 

16 
23 
23 
26 

32 

27 
30 

23 

33 r 2 



A further sa-npling of the above sample waa made by ps^iring student 

from the CAL claes with equivalant students from th^ non-'CAL class 

the matching being based upon ^GE 

SEX 

PRETEST 7 scorn 
SAME CLASS TEACHER? 
This produced a matched pairs SOTple from the schools as follows i 



School 


Number of 
CAL Class 


matclieci students 

T~NON CAL Class 

i 


Dury Falls School 


' 5 


! 5 ' 


Harrow LDdge School 


16 


16 




. 16 


16 


Maylands School 


13 


13 


The C^pion School 


24 


2k 


The Chafford School 


13 


13 


Royal Liberty School 


16 


16 


Frances Barclsley School 


12 


12 


Totals 


115 


115 



0 



Tlin s^ubdlvlHloji of tho unpaii Gd s l;at j.wtical Baiiiplu accordiiKj 
to 3(jx is ful-lowBi- 







f 




GIRLS 


BOY'S 


CAL GRaiP 




115 


NON CAL GHOUP 


86 


; 106 


TOTALS 




" j 221" ^ 



Tho Buhdivision u£ the mafcched pairs sample according to sex 

iB as follOKBi^ 



CAL GRWP 
NON CAL GROUP 



GIRI^ 

1¥ 



Boys 

ji 
81 
162 



The apparently greatei loss of girls than boys in the student 
pairing process. is due mainly to the original pairing of classes 
taught by each teacher- In three cases girls classes at ppposite 
^nds of the ability spectruni ware matched so that the number of 
overlapping students was small. 
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One; of tha ori.iinfil obj uc t lv<.;.s of tlin reHfcarch ifirojact stated that 

« 

til,. woulu fitii'iupt saiK.; Uiiicl of cDiiiivirison hctlvuon wlu-tt aro 

descrj as traditional towel) ing motliCKlH und ttui inc!Uiou& of tl- 
CAl- Hywtetii. It fiomn thut isuch a compariBon can proceed alona 
two iuilhs; oiir.' Joadiiuj to a iloacription of tha dif £'erencea in 
procuduros of thn two methodH, the other to t.',®. differeticoa in 
eflcctH of thesG mothods. This note ia ...naQrawd primarily with 
the effontis of tlio two nietliods. 

COMPAR I NG TEST RE SULTS 

Theorotlcally, the idoa of testing the af fectlvenesa of two diffarent 
teachlno methods rooarding student -.^^aniination purfoniiance seGms a 
relatively simple matter. All we need to do is to pretest two 
matched groups of students In the subject matter to be taught, teach 
one group by one of the two methods to be coiujw.red and the other eroup 
by the other method, post tost the students and compare the results. 
In practice, two maJn difficulties present thcfflBelveEi 

I. enaLJ..inG that the two groups of students are inatched for 

those characteristics which are likely to be relevant in 

affecting any changes in behaviour produced by the teaching 

methods under test, 
ii. e'lsui ing that the terminal behaviours of the two teaching 

methods are similar enough to be comparod by the same tests. 
With rognrd to matching studonts our axparlence in Trials 1 and 2 
suggests that tha following characteristics may have important effects? 
on studont perfornience when using the CjU. sy^tc-mi- 

SEK 

TEACHER 
SCHOOL 

PRE-KNOWLEDOB OF SUBJECT NATTER 

It seems likely that different teacliing methods produce different 
terminal behaviours in the studcnt^.^subj «Ksted to them. This seems 



incviifiblu hut it can bo liiiniiuiiic^d if off or t in oxpandcK! to as^uru 

ilml icinniiktL objocUvciu for cmch « Lage of t\m teaching procodurQ 

nva tho inmv for uach of the tcadiincj motliocls. 

The pracudui'fi wo aclDi^tocl Is m folio\^sj 

1, Uo did not try to defino "traditionnl" teachlncj motliods too closel; 
biit acceptod any method an ^^traditional^' if it took place 
in^ido t\m clrt^iBroom with the teachor as the primary sourc© 
of infonnation. Thus for each stage of the teaching stratogy 
adopted the toacher was the sole arbiior of the tGaching 
in tensity J teaching level and success. The clHtm movaa on 
to the noxt topic when the teacher thought they were ready 
for it. 

Bt A teacher is selected who is capable o£ teaching to a set of 

objectives u^ing the traditional methods and the CAL individual 
learning niethod- 

approximately , . i ^ 

3. Two/ matched clasaes of students are selectedi one class to be 

taught by the traditional method, the other by the CAL learning 

The -teacher decides which of his two classes will be taught 
method, ^j^^ qal method* 

4. The t acher is asked to read through all the CALTS of the 
three ability levels with the class to be taught by 
"traditional" methods in mind* 

5. The teacher selects for the class a series of work tasks 
from the three courses available to cover the content of the 
courses. These can be at any level the teacher thinlcs is 
aultablet and should be enough for five weeks work, 

6. For each of the CALIS selected by tta teachier for his class 
he receives a list of CALO? pbjectives^ 

7. The teacher teaches hia class by whatever method ha thinks 
suitable for each of the objectives, handing out the Ckht 
post tests ::o the students as testa if he thinks it desirable. 

8. The other class is taught using the CM. system with the same 
teacher in charge. 

9. Before the course starts each stiidant is pre-tested with 
tests 7 and 9, and post tested fiva^ weeks later at the end 
of the course using the srae tests* 

In a pilot study we ran of the above procedure the wain difficulty 
encountered by the two teacherr concerned was lu riming the course so 
that the syllabus was completed* We overc^e this problem in Trial 3 
'by starting each teacher on the CAL class first bq that thm equivalent 
non-CAL class was taught later in the week. 

Each class was post tested one week after couplc+ion of the fifth and 



A full description uf Uuj tnachiinj aiKl laarnJiHj activitjr.fci ucmirriiuj ;Ui a 
typical CAL clnoB in provJdacl In tiur booklot onLitled ^^CAL in the CJ a8^u^u0in"C 1973 

Iho teach jiH] iiu'LhodH uHutl on tim nnii-CAL clMHriOH varied from toachor to teachor 
nnd ranood rrofii the movo tradlti cnial lac turo/dninumjtrat ^ on by the tGacIior 
rippj^oach, to the HtufloutH conducLiiiu Ihoir own Gxpc?ri?iian t£^ in small, rp^^'Up^i. 
Tn fact anv nmthod which the teachar felt at daso with vaB used with tho 
noii-CAL cla^B. This iMoari^i of courKO^ that thoro was li mxczli greater varioty 
in teachlnf! nictliodH uBcd on the non-CAL groups, the Gos^iiion denominatDr beinr, 
\h(it the tenfihor wah the primary sourae of infomation* Tho following seem 
to be the major areas difference between what goes mi in a CAL class and 
in a normal science class, 

1. In the non-CAL claHB the teacher is the primary source of 

inforniation wheroaFi in the CAL class this is : the case. 

Ilere the teacher does provide students with infoniiation but 

this is mainly in response to one or tnore students who ask 

for inf oiTiiation# 

3. In the non-CAL classroQm th© student is of tea a passive receiver 
of information. This is less so In the CAL classroom where the 
student is rGsponsible for the organiseitlon of his own work 
activities and is encouraged to seek infoniiation where necessary 
from experiments or the teucher. 

3* In the non-CAL classroom classwork tends to be aimed at the "class 
average*' and not at each individual. The CALTS In CAL classes meet 
more clocely the- individual needs of the student to whom they are 
allocated by the computer. This contrasts witb the non-CAL 
claa^room where all students are asked to do the same classwork 
but with varying degrees of success, 

4. In the non-CAL classroom students are required to work at a pace 
which does not leave the slowest student too far behind. 

In the CAL classronm students can work at their rwn pace. 

5. Because of organisational diflicultl&s scientific practical work 
leans more heavily on teacher demonstration ratiier than individual 

gj^^- student work in the uon-CAL class compared wttl^. the CAL classroom^ 



6. J 11 a iion-CAL fjj nUM tho aca(Uuiij.c liierarchy is Bctt oarly In the liLe 
of Um clLiBS iititi rainains a cjliarac terii? i::i.c for tho Giitlro HIm of 
tho class, Tho difforcnt ^tuclGnt ^orkiiig iiiftthods of a CAL-^cJass 
arn iJknly to i)rculuco a roal or imaginad (in the minds of the 
Btudr_nils) chanfj'J in tills hoirarcliy whicli in turn infJuonces Btudents 
atti tudo.^ to tho CAL systcnu 

Tcuiciiura of the nori'-CAL classos were al lowed to make v^'^ of any of the sixicial 
pieCGH of apparatus usee! in the CAL course Inclr^'ino a s«t of slides on the 
topic of energy i^eleaso* As far as aida were conoemed the only thing that 
teachers were asked not tn do was to hand out the teaching CALTS to the 
non ^CAL claB Si- 
Each class was post testc^d^ using tests 7 and 9 again^ one week after 
complotion of the fifth aim final class lesson* A match#^ 1 pair sample was 
produced from the reoults of pre-and post test 7 using the following prosGdure 

Mat ched pairs ge lection pro CjB dure 

1, Elimi.nale from sample all students who were not present 
for both pre-* and post taste* 

2, Rank each class separately on the basis of jirotest 7 score. 

3, Match studenti^ froni a teachers CAL class wl-tib thosa from his 

non-CAL class on basio of sex and pretest 7 ^ore. 

+ 

The difference in ^^*"e test 7 scores allowed m -3 

4* Compare the two samples produced for each teachor for differenced 
in mean and variance on the pretest scores. 

Results for the matched pairs sample are recorded below* 
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The data used in this Election iy durivDd from the 
follov; Ing sources i 

1. rrotost 7 

2. Pratast 9 

3. Pout taat 7 

4. Post test 9 

5 . Student Opinion Ques tionnairo 



Pre/Po^it Te st 7 

Results for matched pair sample - 115 students in each 
group . 



MEAN 



VARIANCE 



E 


C 




R 




C 


62 .209 


61.809 


MEAN 


73.54I 


68 


* 

. 791 


279 .487 


277.095 


VARIANCE 


274 . 422 


316 


.355 


16 .718 


16.646 


S .D. 


1.6 . 566 


17 


.786 


Protest 7 




Post t! 


2S t 


7 



* The diffGrence bstween these mean is si anif i cant 
(5% level) . 



The roFults for each ability level group are as follows 
LEVEL 1 (4 8 Students in each group) 



MEAN 


78 


. 354 


77. 896 


MEAN ' 


86 


* 

,167 


83. 


* 

771 


VARIANCE 


30. 395 


25.386 


VARIANCE 


48 


. 805 


44. 


344 


S.D. 


5. 


513 


5.038 


S.D, 


6 


. 9 86 


6. 


659 



Pretest 7 



Post tast 7 



* The difference betv;een these two jr.eans Is sicfnificant 
at the 101 level. 
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LEVEL 2 (62 Rtijdents In each group) 





E 


C 




m 


C 


MEAN 


52 .5 32 


52. 129 


MEAN 


6€,3?.3. 


- ■ 

59.984 


VARIANCE 


99.539 


102.886 


VARIANCE 


190.069 


201.080 


S.D. 


9.077 


10.143 


S .D. 


13.787 


14. 180 



Pretest 7 



Post test 7 



These means are significantly different (51 lovel) 



LEVEL 3 

As there are only 5 pairs of level 3 students in the 
matchad pairs sample then the results are not recorded 
in this report* 



g :.in: test 7 

The gain of students eonipleting pretest and post test 
7 is calculated by subtracting thGtr pretest scores 
from their post test scores^ Results for the 
matched pair saiiiplo are as follows^'* 



5 


E 


C 


MEAN 






11 .339 


7.4 70 


VARIANCE 


84.676 


63. &53 


S.D. 


9.202 


7. 972 



The difference 
between those 
neans is higlily 

(1% iQVQl) . , 
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The results £01 each ability level group are as followsi- 
LEVEL 1 (Nuiiibe r of atuden ts 4B per group ) 

E C 



MEAN 

VARIANCE 

S.D. 



7.812 


5. 875 


43. 819 


39.401 


6. 620 


6 .277 
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Mo Bignificnnt 

31 f foK'oriCw:^ hatwooii 
the maana. 



hiNEL 2 (Nu-iibeir p£ H tuclonts - 62 per c rroiipji 





^^^^ 


C 




* 




MEAJJ 


13.790 


8.758 


VARIANCE 


87 ,424 


76 .409 


S. D. ' 

1 


9 .350 


IK 741 



* The difference 
bet-ween these 
means is highly 
sifnlficant 
(1% level) . 



I ho moan score on pretest 7 is approxlmaleLv 56%. 
it the sample is dividad into two groups, the 
first having scotes of 56% and above, the second 
having scores of 551 or below, then the foLlowing 
results are obtained from the gain scores of 
the latter group c*- test 7. 



MEAN 
S.D. 




f-The difference 
between these 
iiieai>s is 
significant 
(at S% level) 
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42 Students in each group 
PreyPost test 9 

■ 

oach^Sroup!" ^"'^ ^"""^-^ ^ studento in 





E 


c 




B 


C 


mm 


17.591 


18 .313 


MEAN 


31. 139 


30.817 




104.537 


101. C41 


VARIANCE 


297.389 


236.184 


S.D. 


aO.22 4 


JO. 082 


S.D. 


17.24 5 


15. 368 



Protest 9 



Post toot 9 



Iljc dlff(3ronco bctvoan theso monns iu sicmificant 

1 4 



The results for each ability lovel group are as follows 
LEVilL 1 (4 8 studcsnts In each group) 

B " c 



E 



MEAN 


24 


.146 


26 


.042 


MEAN 


48 


* 

.792 


41 


* 

.583 


VARIANCE 


103. 


333 


129 


,915 


VARIANCE 


239 . 


.665 


16 9, 


.493 


S.D. 


10. 


165 


11 


398 


S.D. 


15, 


481 


12. 


629 



Pretest 9 



Post test 9 



* The difference between these means is significant 
(5% level) . 



LEVEL 2 (62 students per group ) 
E c 



C 



MEAN 


13.66; 


. 13.726 


MEAN 


25.823 


23.323 


VARIANCE 


52.99^ 


! 54.844 


VARIANCE 


.113.501 


1.53. 347 


S.D. 


7.20C 


1 7.406 




10. r34 


12.385 



GAIN I TEST 9 



The gain of students completing pretest and isost test 9 
is calculated by subtracting their prptest scores from 
their post test scores. Results from the matched pairs 
sample are as follows 



12 



MEAN 


17.548 


12.670 


VARIANCE 


144. 387 


117.995 


S.D. 


12 .016 


10. 863 



* The difference 
between these 
means is highly 
significant 
(1% level) . 
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The gfiins for oach ability iGvel group are given belowi-' 



LEVEIj 1 (Numl^ur 


of students - 48 


in e H< 




K_._ 


C 




Mii,Ar4 


24,641 


16, 4 79 




VARIANCE 


130,687 


91.083 






11,432 


9 ,544 





be tv;een the s e 
means Is 

highly significant 
(1% level) 



LEVEL 2 (Number of students - 62 in each grovp) 

- h C 



MEAN 



VARIANCE 



12.516 


9 .903 


94.314 
9.712 


12/1.765 


11.170 



Basecl on pretest 7 tha sample can be divided into two 
groups; one group Cwiitains students ^*^ith a, score of 
56% or above ^ the other group contains studesits v;ith 
a score of 55% and Uelow, The following reaults are 
from the test 9 gain scores of the latter group. 

E C 



MEAN 



VARIANCE 



11.024 
59 .595 


8. 714. 


74.633 


7.720 


8.639 



42 Btu clontH in each group 



1 
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S t ud£!n t Opi n 1 on Q uest i onn n i re 



At the end of each trial, after they had completed 
their post tests, CAL F;tudents were given an opinion 
questionnairG containing six questions. They were 
asked to select one from the three alternative 
answers qiven for each question. In addition students 
were asked to describe in their own words rmy opinions 
they iiad about the CAL course they had recently" 
completed, Tb^^se results are compiled from the 
qaeiitionnaires the 2 31 students who completed the 
course . 

The results for each of the bxk questions in the student 
questionnaire are listed below: ^ 



1, During CAL Biology I was given 

A, jusu enough work to last through the 
lesson, 

B* too much v7ork, 

too little work. 



2, 







CAL 


GROUP 




A 




B C 


Mean Percentage 


58.9 


25 


.5 15.6 


During CAL Biology 


the 


work 


I was given 



A, too difficult for me. 

B, too easy for ftie . 

C, about right for me. 



Mean Percentage 



CAL GROUP 



ABC 
6,1 3.9 90.0 



3. 



During CAL Biology most of the work I was yivcn 
was 



A. very interesting, 

B. interesting. 

C. not very interesting. 



17 



Mean Percentage 



CAL GR OUP _ 
A B C 

38.6 54>1 27*3 



During CAL Biology I was given 
A, tc^ inuch hoinework, 
b, just enough homework, 
too little homevjork . 



Mean Parcentage 



CAL GROUP 



A B C 

15,1 59,7 25,1 



CAL Biology lessons are 

A, as interesting as ordinary lassons. 

B, ntore Interesting than ordinaxy lessons^* 

C, less interesting than ordiiiary leesonB, 



Mean Percentage 



CAL GROUP 



2S.1 49,3 



C 

25*5 



During CAL Hlology lessons I think I leara. 

A* ^ as mucli as in- ordinary science leaeons, 
less than in ordinary scienca lessons, 
Ci *TOre than in ordinary scienea lessons. 



Mean Percentage 



CAL GROUP 
ABC 
34.6 21.2 44, J 
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Disaissio;: of trial _x ui^^uis"' 



The snmplG of stiulontH used in Trial 3 cont^inB6 a co:i£iidGrataly 
larflor number of hicfii ability «tiideiits Ihicn the ssinploa used in 
either Trial 1 or trial 2^ as is shown by prQ test 7 moan scores^ 

TllIAL 1*.. 52.1 % 

TRIAL 2*.,*..*.** 56*1 % 
TRIAI. 3^..,**.*^. 62.1 % 

This particular sonijde was chofjon t\^o r easons J 

1, To load thD trial against the CA.L system; 

the results from trials 1 ejid 2 imJicated that tho 
CAL fiystoni aave the most benefit t» students of 
below average ability* 

2. To enable ua to coliect more data about the reaction 
of high ability student.n particularly boys, to the 
CAL system. 

The noteB on the interpretation of testa 7 ^^nd 9 described in 
section 8 of our leist report (The Developi^c.^nt of Educational 
Material, The Second Ueport May 1973) ^^^^ apply to the 
discussion of the results of trial 3, 

The reoultB of ^rial 3 bave shed ari intera^Bting light on the 
predictive value of Test 7* This test im nm6 to divide the 
Banii-le into tnree ability level gr^ ps* Nw if this test 
has any value in a predletive role thore sliQUld be a positive 
correlation between a student's performance on the teat and 
hie performance on similar tests. In trial 3 the correlation 
coefficient between scores of pre test 7 aaid post test 9 for 
girls in the CAL classes is 0,77* This cOTitrasts with that for 
the girls in the non-CAL class of 0.6n, A similar state of 
affairs exists for the boys with a correlation coefficient of 
0.73 for tiio CAL Glasses contrasting with O.G? for the non-CAL 
classes. Thuy At rippoarsj that tent 7 1^^^^ ^ hiaher predictive 
power for studonts worlcing within the ^^yi^tcm Mian it has for 

students working un teaciiing material outride the CAL system* 
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TKiG results from trial 3 the CAL sy-'^teni indicfttcf the following* 
1*^ Students tauolit by a toacher using the CAL system as a 
iTUinagemont aid aro likaiy to gain hicjU^r scorofi on tests 
7 and 9 than equivalent students tauoht to the same 
Dbjectives by the samo teacher but without the CAL system 
in a similar time period* 

2* The ai^vantarie described , above and gaiM^d by CAL students over 
n'.^n^CAL students appears to operate over the whole student 
ability range. 

3* The same advunitjage applies to both CAL boys and girls 

eoinpared with non'- CAL boys and girls* This is shown in 
the tables belov^: 



TRIAL 3 MATCHED PAIPB 



CAL GIRia f mhN 
(N ~ 3k) I S.D. 


TEST 7 


TEST 9 ■ 


PRE 


POST 


gain; 




POST 


GAIN 


54-73 
14.62 


68.71 
16.39 


13.97* 
9.9 a 


14.235 
7.252^ 


29.50 
13.76 


15.36 
10.87 


NOM-CAL 
(M = 34) 


' MEAN 
S.D. 


54.73 
14.64 


61.62 
18.33 




14.147 
8.048 


29.26 
15.73 


15.41 ' 
12.0V 



*The difference betiioen theae means is 
highly significant 



7 TRIAL 3 MATCHED PAIRS 









CIIST 7 




TEST 9 










POST 




PRE 


POST 


GAIN 


CAL DOyS 


f MEAN 


65.35 


75.58 




19.00 


37.51 


18.51* 


(N - 81) 




16.55 


16,212 




10.94 


17.99 


12.34 


NON-CAL 
BOYS 


( MFiAN 


64.79 
16.54 


71 •BO 
16*66 


7.71 
8,05 


20.13 
10.22 


31.59 
14.99 


11,5a* 
10,09 



* The difference l>et%tnon these means is 
highly si flnlf leant 



4. The rt-sultB of the stuclent opinion CiUoj-T-tionnaira differ but 
Blight iy from those of the computer nauted students in trials 
:i aficl 3. TIio rMO^^i; noti coable dif fcrctiii. e is revealod in those 
qiiostione (1 and 4) concei^ned with ihcv quantity of work allocated 
by the aompiiter* In trial 3 a gi'eater percentage of students 
camplalncd that they did not receive CrriQugh work to keep them 
fii]]y Qacupiad, particularly homev/ork* This vnriatlaii is 
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probably a roflection o£ the coiistitotiiDn of the trial 3 sample 
which contains a largGr proportion cif ability level 1 boys than 
the samplers for trials 1 and 2. 

5- ^Tiie Qpinion questionnaire confirniB that, girls prefer tlie CAL 

system to a greater ex Lent than boy^ do^ as was indicated by 

^ the reaultH of tilals 1 and 2, The table below contains an 

analysis of the relevant data* 

T^^^AL 3 Students for and against Ckh ' 
Subflivided on Bex 





FOR 




SAMPLE SIZE 


BOYS 


62,9% 


37.1% 


132 


GIRLS 


74.7% 


25*3% 


87 



Analysis of the student opinion questiofinaire oii the basis 
of ability level indicates that tho proportion of students who 
are happy to accept the CAJL. system as a satisfactory method 
of learning is similar for ea^h of tho ability levels- The 
analysis tSible is as follows*"^ 

TRIAL 3 Student.^ for and against CAL 
Subdivided on ability level 



ABILITY 
LEVEh, 


FOR 


AGAINST 


SAMPLE SIZE 


Level 1 


73.714 


36,3% 


57 


Loval 2 


64.714 


35.3% 


m 


I-evel 3 


68.9% 


31.1% 


29 
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Sf^-n s STUDENTS D C) ^;0T I.IKE CAL BTOIXKIY 

riUinov.hAt mora than 25% of tlio students v;h& have taken part in the 
trials of the CAL Biology systGm do not like the system compared with 
the way In which thoy arc norTtia.ly taught biology. At the end of 
each trial tho stuOents wore asked to describcf in their o^m words 
Uioir likes niid dislikes about the CAL systeiiu Analysis of the 
commGnts writtGn by the 25% of the students who do not like the 
CAL system reveals that foui'teen main reasons are commonly lis ted 
by tliese students for not liking the syste^i^.- These .reasons are as 
following:. 

1) Boring v'Qrlc 

It Is not clear what the students mean by the word horirigi 
but the word is used very often by students who do not like 
the CAl. system, 

2) Mono^qjioug p esentation 

Many smidcnts feel that the method of presentation of the CAL 
work is too monotonous. When the system was being designed 
it vras decided to present most of the 'work to the student in 
the forin of short booklets with the inatructions in a form 
resembling a proorammed text. This was the cheapest fonn 
of presentatiQn^ but it vras not knowii at the time how long 
students could put up with this foriB of presentation without 
becoming disatisfied. There seains no doubt that if a variety 
of presentation modes \.ere adopted t:iien this 23% of the students 
not liking the CAL systom could be reduced* 

3) Work too simjjle 

Many of the more able students decided that the work they 
were being asked to do was on the whole too easy. In 
particuiar many disliked the procedure of finding the 
correct answer to the various questions they were asked^ 
in the frames following the questioiifii* Students cOTiplatned 
t>*at other students would mt the questions correct even 
if they did not try very hard and this seemed unfair to them. 
This complaint was particularly prevalent amongst students 
who in normal lessons wore A< the top of the class. It might 
be worth while in the future to ask students whether or not 
they want the corroct answers in tho CALTS w3\ich they are 
giveUi and if they don't then provides tineiii with CALTS which 
^ do not contain the answers, 
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h) Cou r ge _t oo^ 1 ori q 

Some students thought th.it the ccKiima was too long. 
This complaint can be linked to complaint No, 2, Some 
students suggosted that the course ^^^aiild be legs monotonous 
and less tilling if it was altermiteHt on a weekly basis with 
lessons of the normal teacher presented typii. 

5) bo not learn enough 

This complaint Is linked with corapl^int No. 4* Some students 
thought that they did not learn enn^g^ in the amount of time 
spent on the course compared v'ith w^jat thay would in a normal 
Biology lesson* 

This complaint is connected in part with compiaint 2 concerning 
mode of presentation. When used correctly the structured CALTS 
do enable about 70% of students using them to achieve about 
70?4 cor ect answers on t'.a post CALT tests* However j for a 
variety of reasons^ only^ one o£ which is boredom ^ students 
do not alw^ays use the CALTS in th^ prescribed inanner and so 
do not alvcays achieve ma^cery of the CALT subject matter • 
Recent work with the Individually ft^e scribed Instruction 
program j develo^:id by this Learning Research and Development 
Centre of the University of Pittaburgh, described by H,J,01es 
(1073 ) has revealed a high degree of student misuse of self-' 
evaluation opportunities provided by the program. Of the two 
hundred and thirty=eight studerita in the study only 12,15^ 
used the self scoring process in the ways set forth by the 
program developers* 

Finally, the results of trial 3 aa a whole suggest that 
students learn at least as nmch In CAh lessons as they would 
in nortnal Biology lessons even if tLey do not thlnlc so. 

6) Not e n ou gh \ro rk 

Students work at different rates and the amount of work 
comploted by one student in a I'^ssoni can vary considerably 
from that completed by hi.^ peers* Although a mechanism is 
incorporated in the system to provide each student with 
enoUQh work to fill the lesson the ei^chanlsm is not penfect 
and for a small number of students riot enough work is 
provided. This probletn is made morc^ difficult by the fact 
that students do not devote enough timo to making sure that they 
have done the work correct iy, iii many caies simple cofflpletlon 
of the taiik in the fastest tima seenss to provide more 
satisfaction than pettina All the nwR right, 23 



This is i^ai-ticul arl y preval&nt in grammar schools. It is 
essential that this problem of work allocation is solvod as it 
is a major stumblino block on the road to General acceptance of 
CAL syBlcms in schools (see IkmlsS 1*)69) 

7 ) Too niuc-h rushing arQunej. 

Some atuclents thought that they spent so much of the lesson 
rushiny around senrclung for apparatus and deciding what to do, 
that tlioy did not have enough time to finish the work set. 
Certainly the atmosphere in most classes during a CAL sei^ion 
is busy and this active environment does not seem to appeal 
to ail students. 

8) Class control too weak 

This complaint is connected with cowlaint No.?. Some, students 
complained that some of their peers did not work hard enougli 
during CAL lessons and wasted too tnuch time fooling around. 
This disturbed some students and p. evented them from svoiking 
and consetiuontly they preferred the normal class situation in 
which the teacher control was more obvious. 

9,) Do not likowrkinfl alone^ 

Many students do not like working by themselves, and dislike 
being responsible for their own work. Some students mentioned 
that they missed the opportunity to talk with their friends 
who were often doing difforent work %nd did not welcome 
disturbance. This difficulty might be overcome by arranoing 
that some students work in pairs. 

10) Not enoufih attention from the teacher 

Many students who do not like working alone also claimed that 
they did not get enough attention froni the teHcher. This may 
be connBCtod vdth the fact that in raany normal Biology olasFua 
a relatively small number of students are able to monopolise 
the teacher -a attention. However, it also seems likely that 
the CAL system as it stands at the raoment does not allow the 
toaclior to spend enough time -.-ith individuala. This is 
suppoited by the fact that many teachers reported that they 
wore literHlly rushed off their foot durina CAL sessions. 

11) Woi-k not reiovatit 

Many of the low nbility students did not fjol that the work 
they were asked to do had anything to do with Respiration or 
even Biology. Some teachers have resnarkcd that occasionally 
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students mi so involved with the details of the work they are 
doing (iu-irticularl> the analysis ot s^sos) that thoy do not 
see its relovanca in tha context of the course as a whojo. 
A similar state of affairs has bcion reportocl in oth^r attotnpts 
to program scientific ' laboratory work (e.g. Powell and French 
1972) 

12) Too many tests 

Some of tha low abi u'ty ' students comrlainead that there were too 
inan> +oats in the system and that they had to do too much reading. 

13) Work is siljy 

Some of the high ability students coniplained that many of the 
things they were asked to do and read were childish and silly. 
Some thought that most of the Jokes in the system were stupid. 

14) Too much writing and jjaptirwork 

Many of the low ability students coLnplained that they had too 
much writing to do and had to read too much written paper work. 
This complaint is similar to and connected with Complaint No.2 
conce ■nlng monotonous preaentation. 

Finally, it chould be rocorded that some students form temporary 
mental attflchinents to their teachers and regard the CAL system 
aa Rorttkind of threat to their teachers. Loyally, these students 
automatlcaHy oppose the CAL system. This response Is particularly 
cnarked when the teacher is clearly physical ly attractive and of the 
sex opposite to that of ^ the students. As might be expected these 
last statompnts are the writer's interpretation of comments written 
by various students and not the comments themselves. 

It should be noted that there is no evideirace to suggest that students 
who prnfess a dislike of this CAL system do any worse on the post 
tests than those students who like it. A similar state of affairs 
has been repoi ted in other studios particnilarly in the field of 
programmed learning (El lams 1969) • 

In nddltion, it is likely that a proportion of these students who 
do not like the CAL system are aliergic to school and education 
generally. This is perhops particularly important In the age group 
of the sample, which is approaching the am d'^ and 15 years) when 
differences between industrious and allergig pupils are most marked. 
. (Sumnor and Warburton 1972) 25.;, . y. 
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i XXXaXXXXXKXXX'vX} XXXXaXXaX xxxxx 

0-9 xxxxxxx:cxxxxxxxxxxx.x:<XKXXXXsxx 
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inAi. 3 CM. onouv post test 9 
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TRIAL 3 NON CAL :aU)UP PRHTEST 7 
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TRIAL 3 NON CAL GHCH IP POST TEST 7 



0-9 



10 " 19 4 X 

i X 



XXX 

20 - 29 I XXX 
XXX 



30 - 39 



XXXX 
X3QQC 
XXXX 



XXXXXXJOOQOC 
40 - 49 XX}QCXXX30CXX 

xxx)Ocxx)aoDC 

XXXXXXXX)00Q0O0OC 
50 - 59 XXXXXXIODDCQOQOQC 
XXJCXXXXKXX}QOCX}QC 

x3DDcx}ooaarwOOQc 
60 " 69 xxjacraoDoaaoQQC 

XXK}CCXX}mOGOTQC 

3aOQC3QOODDDDroC)OQQODQOCX?OC 
70 " 79 XXXXXXOTmDCSOQQQDDaOOaQC 
)QC}QCX30QQOQQOOOCXBCX}roora 

^QCDr;QODOQnQQDC^OOmQQraCXX}0^ 
80 - 89 M(OTQ00DQD00CX300QC)Q00aaDD0^ 

XXXX)DQ0O00QQO0CX}00C7JaQ00CX}0^^ 

X^QODQOOQC 
90 - 99 )QOQOQQQOC 
X}DDOQOOQC 



31 



TUTAl. 3 
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OpmTION OF THE C>A,L. SYSTEM 



In tho report ^'Off-'Llne Computer Aided Learning Proj©ct„The Development 
of Educational Matorlal.Tho Second Report" statistics about the operational 
aspGcts of the C.A«Lp system wore given* A very similar system has been 
used in this third trial but the following modif leations have been mad© since 
the second trial. 

a) Part of the main suite of programs has been "chained" to reduce operator 
Intervention^ 

b) In trial 2 cnly 50% of the students were routed. In trial 3 this figuri^ 
increased to 100%, 

c) The routing algorithm has been modified to flpeed up the process of routing 
students, 

d) Output from the rGSpcnse input program has been changed to the linepr inter 

e) Input to the file set up and start of marking program (CAL 6) has been 
modified* 

The total population used in these statistics is 353 students from cdtiprehensive 
sehcrls. Class si^es were as follows. 

PI, 17, 29, 39f 30, 31, 29i 34, 33 

Durlno the trial tho cnlculatad cost of production (same fonn of calculation 
as used last timo) for oach v/©ek varied from £22-58 to £15^57 per hundred 
student hours of material. This variation is shown below. 
W^.ek No* 1 2 3 4 5 6 

Cost £ 22.58 21,61 19*10 20*67 15*57 16-94 

Some of this variation is explained by the operators and teachers gaining more 
experience with uaino the STStem* weveri the reduction in week 5 is due to 
a high proportion of Teacher allocations being made (reducing the computer time 
spent on routing) and in v/oek 6 all the final output frrm the system (our 
equivalent of "end of term reports") is Included, 

The cost of producing 100 student hours material in trlali 2 and 3 are compared 
in the table below. 



EKLC 





Trial 2 




Trial 3 


Initial Checking 
and Punching 


3.78 




3.63 


Checking 


2.27 




a. 39 


Correcting 


1,00 




1,01 


Run Time and 
Dumping 


12.97 




11.44 


Splitting up 
and rnaking u-^ 


1-57 




1.09 


TOTAL 


21.59 


34 


19 .46 


All #ntriei are in £s. 







It will bo uQBn that prlncl-U© savings have been made in computer time 
and the splitting u;: and mnkino up oporations* 

The saving of computor timu is Juo tu the changes described abova. 

The splitting up anJ niakino up costs v/ill be removed in a 'non' rasoarch 
f?nvironment« Thus a prociuction system cost will be £18-37 per 100 
student hours ^ Our axpoctation is that v/a should be ablo to improve 
cm this situation, -/^ lid in the latter part of the course^ 

The costs of the first three items in the table have not altered 
significantly Jurinc: the two trinla* Mudification tu the computer 
ays \ em aro in hand that we should bo able tc reduce those items 
signif icantJy at th^i expGnse of increasing thj computer time. 

Even if the ovorall ccsta are increasQd temporarily the labour costs 
tend to incrGaae with timOi whilst the amount of processing one can do 
on a comijutor for Cl increases froni year to yeari this all means that 
tending to place ccsts in categories which are not labour Intensive v/ill 
contribute to tho j . ng torm cost reduction objectives of the system. 
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